[TRTLLMINF-40][chore] Dedupe COMMON_SSH_OPTIONS to reference bloom's DEFAULT_CUSTOM_SSH_OPTIONS by brnguyen2 · Pull Request #17706 · NVIDIA/TensorRT-LLM

brnguyen2 · 2026-08-14T12:58:10Z

Summary

jenkins/L0_Test.groovy defined COMMON_SSH_OPTIONS as a string literal that duplicated com.nvidia.bloom.Utils.DEFAULT_CUSTOM_SSH_OPTIONS in the bloom Jenkins shared library. This replaces the literal with a reference to the canonical constant:

COMMON_SSH_OPTIONS = Utils.DEFAULT_CUSTOM_SSH_OPTIONS

Utils (com.nvidia.bloom.Utils) is already imported (line 28), so no new import is added. All existing call sites that interpolate ${COMMON_SSH_OPTIONS} are unchanged.

Motivation

The two definitions had already drifted: bloom's DEFAULT_CUSTOM_SSH_OPTIONS gained -o ConnectTimeout=15 (from [TRTLLMINF-99], to stop SLURM frontend probes hanging), while this local literal still had no connect timeout. Referencing the canonical constant gives a single source of truth so the options can't diverge again.

Effect (not a no-op)

Because bloom's constant now carries ConnectTimeout=15, this dedupe adds a 15s connect timeout to the ssh/scp calls that use COMMON_SSH_OPTIONS in L0_Test.groovy (the result-download scp and the debug-VM ssh), bounding hung connects instead of relying on the OS default. This is safe:

The download scp already wraps in numRetries: 3, so a bounded-then-retried connect is strictly better than an unbounded hang.
COMMON_SSH_OPTIONS here is independent of bloom's SLURM-frontend-probe path (that path uses bloom's constant directly and has its own 30s backstop), so there is no interaction with the TRTLLMINF-99 probe invariant.

The other options (StrictHostKeyChecking, UserKnownHostsFile, TCPKeepAlive, ServerAliveInterval, ServerAliveCountMax) are unchanged.

Dev Engineer Review

jenkins/L0_Test.groovy now uses Utils.DEFAULT_CUSTOM_SSH_OPTIONS.
This removes the duplicate SSH option string.
The shared constant provides a 15-second SSH connect timeout.
Existing call sites remain unchanged.
No public API, test list, or test code changes were made.
The change is small and consistent with a single-source-of-truth design.
CI still reports failures or unstable results. Further CI investigation and reruns are required.
A tracking bug for CI-waived tests remains to be filed.

QA Engineer Review

No test changes.

File a tracking bug for the CI-waived test(s) and record it with pr-babysitter waive set-bug NVIDIA/TensorRT-LLM#17706 <bug-url> — the waives entry carries a placeholder until then

coderabbitai · 2026-08-14T13:00:59Z

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 6073c659-7866-48b2-8427-eb1fbeb86417

📥 Commits

Reviewing files that changed from the base of the PR and between 1984a29 and 6f83fcb.

📒 Files selected for processing (1)

jenkins/L0_Test.groovy

🚧 Files skipped from review as they are similar to previous changes (1)

jenkins/L0_Test.groovy

Included review availability: Your plan includes up to 12 reviews per rolling hour; 10 remain after this review.

Walkthrough

The Jenkins test configuration now obtains COMMON_SSH_OPTIONS from the shared Utils.DEFAULT_CUSTOM_SSH_OPTIONS value.

Changes

Test Configuration Updates

Layer / File(s)	Summary
Use shared SSH options `jenkins/L0_Test.groovy`	`COMMON_SSH_OPTIONS` now references `Utils.DEFAULT_CUSTOM_SSH_OPTIONS` instead of an inline SSH option string.

Estimated code review effort: 1 (Trivial) | ~2 minutes

Merge Risk: ⚪ Minimal · up to 6f83f

This change centralizes SSH options and adds a bounded 15-second connection timeout to the affected CI transfers; no actionable merge-blocking risk remains beyond normal checks and review.

Suggested reviewers: yiqingy0

🚥 Pre-merge checks | ✅ 5

✅ Passed checks (5 passed)

Check name	Status	Explanation
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Title check	✅ Passed	The title clearly identifies the deduplication of COMMON_SSH_OPTIONS and reference to the canonical shared constant.
Description check	✅ Passed	The description clearly explains the change, motivation, impact, and checklist state; the missing Test Coverage section is a minor omission.

✨ Finishing Touches 💡 1

🛠️ Fix failing CI checks 💡

Create stacked PR
Commit on current branch

🧪 Generate unit tests (beta)

Create PR with unit tests

_{Comment @coderabbitai help to get the list of available commands.}

brnguyen2 · 2026-08-14T13:25:25Z

/bot run

tensorrt-cicd · 2026-08-14T13:30:50Z

PR_Github #66282 [ run ] triggered by Bot. Commit: 9fd31e0 Link to invocation

tensorrt-cicd · 2026-08-14T16:18:07Z

PR_Github #66282 [ run ] completed with state SUCCESS. Commit: 9fd31e0
/LLM/main/L0_MergeRequest_PR pipeline #53942 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

brnguyen2 · 2026-08-14T19:07:13Z

/bot run

tensorrt-cicd · 2026-08-14T19:12:59Z

PR_Github #66351 [ run ] triggered by Bot. Commit: 9fd31e0 Link to invocation

tensorrt-cicd · 2026-08-14T20:26:32Z

PR_Github #66351 [ run ] completed with state SUCCESS. Commit: 9fd31e0
/LLM/main/L0_MergeRequest_PR pipeline #53994 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

brnguyen2 · 2026-08-14T20:34:44Z

/bot run

tensorrt-cicd · 2026-08-14T20:41:17Z

PR_Github #66372 [ run ] triggered by Bot. Commit: 9fd31e0 Link to invocation

tensorrt-cicd · 2026-08-15T00:00:04Z

PR_Github #66372 [ run ] completed with state SUCCESS. Commit: 9fd31e0
/LLM/main/L0_MergeRequest_PR pipeline #54015 completed with status: 'UNSTABLE'

CI Report

⚠️ Multi-GPU Label Required:
Multi-GPU tests require the ci: full pre-merge approved label on this PR. Ask a member of NVIDIA/trt-llm-ci-approvers to add the label, then re-trigger CI with the same bot command (no rebase needed).

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

brnguyen2 · 2026-08-15T00:00:26Z

/bot run

tensorrt-cicd · 2026-08-15T00:07:22Z

PR_Github #66403 [ run ] triggered by Bot. Commit: 9fd31e0 Link to invocation

tensorrt-cicd · 2026-08-15T00:27:57Z

PR_Github #66403 [ run ] completed with state FAILURE. Commit: 9fd31e0
/LLM/main/L0_MergeRequest_PR pipeline #54046 completed with status: 'UNSTABLE'

CI Report

⚠️ Multi-GPU Label Required:
Multi-GPU tests require the ci: full pre-merge approved label on this PR. Ask a member of NVIDIA/trt-llm-ci-approvers to add the label, then re-trigger CI with the same bot command (no rebase needed).

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

brnguyen2 · 2026-08-15T00:41:42Z

/bot run

tensorrt-cicd · 2026-08-15T00:48:09Z

PR_Github #66405 [ run ] triggered by Bot. Commit: 9fd31e0 Link to invocation

tensorrt-cicd · 2026-08-15T03:00:58Z

PR_Github #66405 [ run ] completed with state FAILURE. Commit: 9fd31e0
/LLM/main/L0_MergeRequest_PR pipeline #54048 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

brnguyen2 · 2026-08-15T03:07:18Z

/bot run

brnguyen2 · 2026-08-15T03:29:11Z

/bot run

tensorrt-cicd · 2026-08-15T03:35:28Z

PR_Github #66426 [ run ] triggered by Bot. Commit: 1984a29 Link to invocation

tensorrt-cicd · 2026-08-15T15:11:22Z

PR_Github #66426 [ run ] completed with state FAILURE. Commit: 1984a29
/LLM/main/L0_MergeRequest_PR pipeline #54068 completed with status: 'UNSTABLE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

brnguyen2 · 2026-08-16T22:34:29Z

/bot run

tensorrt-cicd · 2026-08-16T22:40:03Z

PR_Github #66562 [ run ] triggered by Bot. Commit: 1984a29 Link to invocation

brnguyen2 · 2026-08-17T01:22:29Z

/bot run

tensorrt-cicd · 2026-08-17T01:27:39Z

PR_Github #66580 [ run ] triggered by Bot. Commit: 6f83fcb Link to invocation

tensorrt-cicd · 2026-08-17T01:30:26Z

PR_Github #66562 [ run ] completed with state ABORTED. Commit: 1984a29

Link to invocation

tensorrt-cicd · 2026-08-17T01:50:14Z

PR_Github #66580 [ run ] completed with state FAILURE. Commit: 6f83fcb
/LLM/main/L0_MergeRequest_PR pipeline #54210 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

brnguyen2 · 2026-08-17T02:20:10Z

/bot run

…DEFAULT_CUSTOM_SSH_OPTIONS Signed-off-by: Brian Nguyen <brnguyen@nvidia.com>

brnguyen2 · 2026-08-17T02:20:22Z

/bot run

tensorrt-cicd · 2026-08-17T02:26:43Z

PR_Github #66601 [ run ] triggered by Bot. Commit: 156dc57 Link to invocation

tensorrt-cicd · 2026-08-17T02:27:50Z

PR_Github #66602 [ run ] triggered by Bot. Commit: 156dc57 Link to invocation

tensorrt-cicd · 2026-08-17T02:27:52Z

PR_Github #66601 [ run ] completed with state ABORTED. Commit: 156dc57

Link to invocation

tensorrt-cicd · 2026-08-17T08:52:17Z

PR_Github #66602 [ run ] completed with state FAILURE. Commit: 156dc57
/LLM/main/L0_MergeRequest_PR pipeline #54225 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

brnguyen2 · 2026-08-17T08:56:01Z

/bot run

tensorrt-cicd · 2026-08-17T09:02:04Z

PR_Github #66713 [ run ] triggered by Bot. Commit: 156dc57 Link to invocation

tensorrt-cicd · 2026-08-17T09:03:58Z

PR_Github #66713 [ run ] completed with state FAILURE. Commit: 156dc57

Link to invocation

brnguyen2 · 2026-08-17T10:42:22Z

/bot run

tensorrt-cicd · 2026-08-17T10:47:34Z

PR_Github #66737 [ run ] triggered by Bot. Commit: 156dc57 Link to invocation

tensorrt-cicd · 2026-08-17T12:33:32Z

PR_Github #66737 [ run ] completed with state SUCCESS. Commit: 156dc57
/LLM/main/L0_MergeRequest_PR pipeline #54344 completed with status: 'SUCCESS'

CI Report

Link to invocation

brnguyen2 requested a review from a team as a code owner August 14, 2026 12:58

brnguyen2 requested review from dpitman-nvda and yiqingy0 August 14, 2026 12:58

github-actions Bot assigned brnguyen2 Aug 14, 2026

brnguyen2 added the ci: full pre-merge approved label Aug 15, 2026

brnguyen2 force-pushed the user/brnguyen/dedupe-common-ssh-options branch from 2462730 to 1984a29 Compare August 15, 2026 03:29

brnguyen2 force-pushed the user/brnguyen/dedupe-common-ssh-options branch from 1984a29 to 6f83fcb Compare August 17, 2026 01:22

[TRTLLMINF-40][chore] Dedupe COMMON_SSH_OPTIONS to reference bloom's …

156dc57

…DEFAULT_CUSTOM_SSH_OPTIONS Signed-off-by: Brian Nguyen <brnguyen@nvidia.com>

brnguyen2 force-pushed the user/brnguyen/dedupe-common-ssh-options branch from 6f83fcb to 156dc57 Compare August 17, 2026 02:20

chzblych approved these changes Aug 17, 2026

View reviewed changes

brnguyen2 merged commit 215b7e4 into NVIDIA:main Aug 17, 2026
7 checks passed

Uh oh!

Conversation

brnguyen2 commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Motivation

Effect (not a no-op)

Dev Engineer Review

QA Engineer Review

Uh oh!

coderabbitai Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Walkthrough

Changes

Uh oh!

brnguyen2 commented Aug 14, 2026

Uh oh!

tensorrt-cicd commented Aug 14, 2026

Uh oh!

tensorrt-cicd commented Aug 14, 2026

Uh oh!

brnguyen2 commented Aug 14, 2026

Uh oh!

tensorrt-cicd commented Aug 14, 2026

Uh oh!

tensorrt-cicd commented Aug 14, 2026

Uh oh!

brnguyen2 commented Aug 14, 2026

Uh oh!

tensorrt-cicd commented Aug 14, 2026

Uh oh!

tensorrt-cicd commented Aug 15, 2026

Uh oh!

brnguyen2 commented Aug 15, 2026

Uh oh!

tensorrt-cicd commented Aug 15, 2026

Uh oh!

tensorrt-cicd commented Aug 15, 2026

Uh oh!

brnguyen2 commented Aug 15, 2026

Uh oh!

tensorrt-cicd commented Aug 15, 2026

Uh oh!

tensorrt-cicd commented Aug 15, 2026

Uh oh!

brnguyen2 commented Aug 15, 2026

Uh oh!

brnguyen2 commented Aug 15, 2026

Uh oh!

tensorrt-cicd commented Aug 15, 2026

Uh oh!

tensorrt-cicd commented Aug 15, 2026

Uh oh!

brnguyen2 commented Aug 16, 2026

Uh oh!

tensorrt-cicd commented Aug 16, 2026

Uh oh!

brnguyen2 commented Aug 17, 2026

Uh oh!

tensorrt-cicd commented Aug 17, 2026

Uh oh!

tensorrt-cicd commented Aug 17, 2026

Uh oh!

tensorrt-cicd commented Aug 17, 2026

Uh oh!

brnguyen2 commented Aug 17, 2026

Uh oh!

brnguyen2 commented Aug 17, 2026

Uh oh!

tensorrt-cicd commented Aug 17, 2026

Uh oh!

tensorrt-cicd commented Aug 17, 2026

Uh oh!

tensorrt-cicd commented Aug 17, 2026

Uh oh!

tensorrt-cicd commented Aug 17, 2026

Uh oh!

brnguyen2 commented Aug 17, 2026

Uh oh!

tensorrt-cicd commented Aug 17, 2026

brnguyen2 commented Aug 14, 2026 •

edited

Loading

coderabbitai Bot commented Aug 14, 2026 •

edited

Loading